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Abstract 

We consider a problem of optimal control of an infinite horizon system 
governed by forward-backward stochastic differential equations with delay. 
Sufficient and necessary maximum principles for optimal control under 
partial information in infinite horizon are derived. We illustrate our results 
by an application to a problem of optimal consumption with respect to 
recursive utility from a cash flow with delay. 
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1 Introduction 

Let {fl,J-, {J^t)t>o, P) be a complete filtered probability space on which a one- 
dimensional standard Brownian motion B {■) and an independent compensated 
Poisson random measure N(dt, da) = N{dt, da) — v{da)dt are defined. 

We study the following infinite horizon coupled forward-backward stochastic 
differential equations (FBSDEs, for short) control system with delay: 
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(FORWARD EQUATION) 



dX{t) = b {t, X{t), Xi{t), X2it), u{t)) dt + a {t, X{t), Xi{t), X2{t), u{t)) dB{t) 

+ J e {t,X{t),Xi{t),X2{t),u{t),a) N{dt,da);t e [0, oo) 

Ro 

x{t) = Xo{ty, tG[-6,o] 

(1.1) 

where 

Xi{t) = X{t - 5) and X2{t) = J e'P^^-''"' X{r)dr. 

t-5 

(BACKWARD EQUATION) 



dY{t) = -g{t,X{t),Xi{t),X2{t),Y{t),Z{t),u{t))dt + Z{t)dB{t) 

+ jK{t, a)N{dt,da);tG[0,oo)- (1-2) 

Ko 

Throughout this paper, we introduce the following basic assumptions 

S > 0, p > arc given constants, 

b:[0,oo)xRxRxRxUxn^R, 

a -.[0,00) xRxRxRxU xQ.^R, 

g:[0,oo)xRxRxRxRxRxUxn^R, 

6*, if : [0, cx)) X R X M X M X W X Ko X O ^ R, 

/:[0,oo)xIRxRxRxRxRx7^xWx^^■R, 

h:R^R, 

where the coefficients 6, a, 9a,nd g are Frechet differentiable (C^) with respect 
to the variables (x, xi,X2, y, z, u). 

We denote by U, the set of all functions fc : Rq := R\{0} R. 

We interprete the infinite horizon BSDE (1.2) in the sense of Pardoux [16], 
i.e. for all T < oo, {Y{t), Z{t), K {t, •)) solves the equation 



Y{t) = Y{T) + fg {s, X{s), Xi(s), ^2(5), Y{s), Z{s)) ds - JZ{s)dB{s) 
t t 

T 

- J jK{s,a) N{ds, da); Q<t<T, 

tKo 

(1.3) 

and moreover, 

00 

£[sup e^*Y^{t) + Je^\Z^{t) + f {s,a) u{da))dt\ < 00 (1.4) 

t>0 Ro 

for sufficiently large constant A. See section 4 in [16] for more details. 
Note that by the Ito represtnitation theorem for Levy processes ( see [20]), 
equation (1.3) is equivalent to the equation 
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Y{t) = E[Y{T) + Jg (s, X{s), ^2(5), Y{s),Z{s)) ds \ Tt]; t < T, 

t 

for all T < 00. 

(1.5) 

Let £t C be a given subfiltration, representing the information available 
to the controller at time t. 

Let W be a non-empty convex subset of M. We let As denote a given locally 
convex family of admissible fj-predictable control processes with values in U. 

The corresponding performance functional is 

00 

J{u) = E[Jf{t, X{t), X2{t), Y{t),Z{t),K {t, •) , u{t)) dt + /i(F(0))] 



(1-6) 

where we assume that the functions / and h are Frechet differentiable (C^) 
with respect to the variables {x,xi,X2,y, z,k{-),u) and Y{0), respectively, and 
/ satisfies 

00 

E[J\f{t,X{t),X^{t),X2{t),Y{t),Z{t),K{t,-),u{t)) \dt]<^. (1.7) 


The optimal control problem is to find an optimal control u* e As and the 
value function e M such that 

$^(Xo) = sup J(u) = J(u*) (1.8) 

uGAe 

We will study this problem by rising a version of the maximum principle 
which is a combination of the infinite horizon maximiim principle in [1] and the 
finite horizon maximum principle for FBSDEs in [12] and [15]. 

The Hamiltonian 

i?:[0, cx))xRxRxRxRxMx L'^{u) xf/xMxRxMx L'^{u) M 
is defined as 

H{t, X, x-i,X2,y, z, k{-), u, X,p, q, r{-)) = f{t, x, xi,X2,y, z, k, u) + g{t, x, x-i,X2, y, z, u)X 
+ b{t, X, xi,X2, u)p + a{t,x,xi,X2,u)q + J 9{t, x,xi,X2,u, a)r{t, a)v{da). 

Ro 

(1.9) 

We suppose that the Hamiltonian H is Frechet differentiable (C^) in the 
variables x, xi,X2, y, z, k. 

We associate to the problem (1.8) the following pair of forward- backward 
SDEs in the adjoint processes \{t), ( p{t),q{t),r{t, •)): 
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(ADJOINT FORWARD EQUATION) 



dX{t) = ^{t, X{t), X^{t),X2{t), Yit), Z{t), K{t, •), u{t),X{t),p(t),q{t), r{t, •)) dt 

+ ^{t, X{t), Xi{t),X2{t), Y{t), Zit), Kit, •), u{t),Xit),p{t),q{t), r{t, ■)) dB{t) 

+ JVkH{t, X{t),X,{t), X2{t),Y{t), Z{t), K{t, •), u{t), X{t),p{t), q{t), r(i, ■))N{dt, da) 

Mo 

X{0)=h'{Y{0)) 

(1.10) 

(ADJOINT BACKWARD EQUATION) 



dp{t) = E[i^{t) I Tt]dt + q{t)dB{t) + J r{t, a)N{dt, da);t G [0, oo) (1.11) 

Ko 

where 



M*) = -If (i, X{t),X,{t), X2{t),Y{t),Z{t),K{t, ■),u{t), X{t),p{t), q{t),r{t, •)) 
(t + (5, X{t + 5), Xi{t + 6),X2{t + S), Y{t + S), Z{t + S), K{t + 6,-), 

u{t + 6), X{t + 6),p{t + 5), q{t + S), r{t + S, •)) 

t+s 

/ X{s),X,is),X2{s),Y{s), Z{s),K{s, •), u{s), X{s),p{s), q{s), r{s, ■))e-P'ds). 

(1.12) 

The unknown process X{t) is the adjoint process corresponding to the back- 
ward system {Y{t),Z{t),K{t,a)) and the triple unknown {p{t),q{t),r{t,a)) is 
the adjoint process corresponding to the forward system X{t). 

We show that in this infinite horizon setting the missing terminal conditions 
for the BSDEs for {Y{t), Z{t), K{t, •)) and {p{t), q{t), r{t, •)) should be replaced 
by asymptotic transvcrsahty conditions. Sec (-ffi) and (-ffs) below. 

In this paper we obtain a sufficient and a necessary maximum principle 
for infinite horizon control of FBSDEs with delay. As an illustration we solve 
explicitly an infinite horizon optimal consumption problem with recursive utility. 
Related papers dealing with infinite horizon control, but either without FB 
systems or without delay, are [1], [8], [17] and [21]. Other related stochastic 
control publications dealing with finite horizon only are [2], [3], [4], [5], [6], [7], 
[9], [10], [11], [12], [13], [14], [15], [16], [18], [19], [20] and [22]. 



2 Sufficient maximum principle for partial in- 
formation 

We will prove in this section that under some assumptions the maximization of 
the Hamiltonian leads to an optimal control. 
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Theorem 2.1 Letii G As with corresponding solutions X{t), Xi{t), X2{t),y{t), Z{t}, 
K{t,a),p{t),q{t),r{t,a) and X{t) of equations (1.1), (1.2), (1.10) and (1.11). 

Suppose that: 

(Hi): (Transversality conditions) 



lim E[ p{T){X{T) - X{T))] < 

T->-oo 



and 



limS[A(T)(y(T)-y(T))]>0. 

J — >oo 



{H2): ( Concavity) 

The functions x — )• h{x) and 

{x, xi ,X2,y, z, k, u) H{t, x, xi ,X2,y, z, k{-), u, A, p, q, f{-)) 

are concave, for all t € [0, 00). 

{H3): (The conditional maximum principle) 

maxE[H{t, X{t), Xi{t), X2{t),Y{t), Z{t), k{t, ■),v, Xit),p{t), q{t), f{t, ■)) | £i] 

= E[Hit, X{t), X,{t), X2{t),Y{t)J{t),k{t, ■),u(t), \(t),p{t),m,r{t, •)) I £1] ■ 

{Hi): ( Growth conditions) Suppose for all u G Ae that the following holds: 

00 . 2 

E[f{Y{t)-Y{t)n{^{t)f + J VuH{t,a) u{da))dt]<^ (2.1) 

Ro 
00 

E[JX^{t){{Z{t) - Z{t)f + J {k{t, a) - K{t, a)fu{da)}dt] < 00 (2.2) 

Ro 



E[J{X{t) - X{t)f{f{t) + J r'^{t,a)iy{da)}dt] < 00 (2.3) 

Mo 
00 

E[If{t){{a{t) - a{t)f + J {§{t, a) - e{t, a)fu{da)}dt] < 00 (2.4) 



where X{t), Xi{t),X2{t),Y{t),Z{t),K{t,a) are the solutions 0/ (1.1), (1.2) 
corresponding to u, and we are using the notation 

H W = Mt),Mt), Y{t), z{t), k{t, •), z, x{t),m, m, r{t, •)) L=z(t) 

and similarly with \7kH{t,a). 

Then u{t) is an optimal control for (1.8), i.e. 

J{u) = sup J{u). 

ueAe 

Proof. Assume that u ^ Ae- We want to prove that J{u) — J{u) > 0, i.e.u is an optimal control. 
We put 

J{u) - J{u) =h+h (2.5) 
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(2.6) 



where 

oo 

h = E[S {f{t, X{t), Xi it), Mt),Y{t), Z{t), K{t, ■),uit)) 



-f{t,X{t),X,{t),X2{t),Y{t),Z{t), K{t,-),u{t))} dt] 

and 

h = E[h{Y{0))-h{Ym. 
By the definition of we have 

oo 

h = E[j{{H{t) - H{t)) - im - 9{t))m - im - Ktmt) 



-{a{t) - a{t))q{t) - J {9{t,a) - e{t,a))f{t,a)v{da)}dt] 

Ro 

where we have used the simphfied notation 

H{t) = H{t, X{t),X,{t),Mt), Y{t),Z{t),k{t, •), u{t)Mt),mA{t), f{t, ■)) 
H{t) = H{t, X{t),X,{t), X2{t),Y{t), Z{t), K{t, •), u{t), X{t),m, m,f{t, •)) etc. 

Since h is concave, we have 

hiYio)) hiYm > /.'(f(o))(y(o) - y(o)) = A(o)(f(o) - y(o)) . 

By Ito's formula, {H4), (1.2) and (1.10), we have for all T 

E[XmY{0) - Y{0))] = E[X{T){Y{T) - Y{T)) 

-]x{t)d{Y{t) - Y(t)) - ]{Y{t) - Y{t))dX{t) 


- j{Z{t) - Z{t))%{t)dt -J J VkH{t, a){K{t, a) - K{t, a))u{da)dt] 

Mo 

Letting T — > 00, we obtain 



E[XmY{0) - y(0))] = lim E [X{T){Y{T) - Y{T))] 

T— j-oo 

00 - „ 

-E[j{-xmm - m) + {Y{t) - Y{t))%{t) + {m - z{t))^{t) 

+ J VkH{t, a){K{t, a) - K{t, a))u{da)}dt]. (2 7) 

Combining (2.6) — (2.7), we obtain 



J{u) - J{u) > lim E [X{T){Y{T) - Y{T))] 

T->oo 



+EU{m) - H{t)) - m - b{tmt) - {a{t) - a{t))m 

-J{e{t,a) - e{t,a))f{t,a)v{da) - {Y{t) - Y{t))^{t) - {Z{t) - Z{t))%{t) 

- / VkH{t,a){k{t,a) - K{t,a))v{da)}dt]. 
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Since H is concave, we have 

oc 

J{u) J{u) > lim E [X{T){Y{T) Y{T))] + E[J{{X{t) X{t))^{t) 

1 — )-00 Q 

+ {Mt) X,it))M.{t) + (Mt) - X,{t))§S-it) + {u{t) - u{t))^{t) 
-(b{t) - b(t))p{t) ~ {a{t) - a{t))q{t) - J {e{t,a) - e{t,a))r{t,a)v{da)}dt]. 

Mo 

(2.8) 

Applying now {Hi), {H4) together with the Ito formula to p{T){X{T) - X{T)) 
we get 

> lim S [ p{T){X{T) - X{T))] 

= E[j{m bitmt) - {x{t) - x{t))E[m \ j-*] 


+ {a{t) - cF{t))q{t) + / {e{t, a) - 0{t, a))f{t, a)u{da))dt\ 

Ro 

00 

= E[jm) - mm) - im - mm) 


+{a{t) - a{t))q{t) + J {§{1, a) - e{t, a))f{t, a)u{da)}dt]. 9) 

Mo 

By the definition (1.12) of /i , we have 

00 

E\ J{X{t)-X{t))fi{t)dt] 


T+5 



lim E[ J {{X{t -S)- X{t - S))ii{t - S)dt)] 

T+5 



= lim E[{- J ^{t- S){X{t -S)- X{t - S))dt 

T-)-oo g 

T+S . T+S t 

- / ir W (Mt) - Xi{t))dt - / ( / ||L (.) e-P^ds)- 

5 6 t-5 

.eP(^-S){X{t-6)-X{t-S)))dt] . (2.10) 
Substituting r = t — S, we obtain 

J§^{s){Ms)-X2is))ds 



= I§fM I e-''^^-^\X{r)-X{r))drds 

s-5 

= IiT§iis)e-''^ds)e''^{X{r) - X{r)) dr 

r 
T+S t 

= / ( / («) e-^«ds)e^(*-*)(X(t -5)- X{t - 5))dt . (2.11) 

S t-5 
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Combining (2.8) with (2.9) - (2.11), we deduce that 



J{u) - J{u) > Hm E [A(T)(F(T) - F(T))] - lim E\p{T){X{T) - X{T))] 

T->oo T->-oo 
oo 

+E[J{u{t)-u{t))^{t)dt] 





= Hm E[ X{T){Y{T) - Y{T))] - lun E [p{T){X{T) - X{T))] 

T-foo T^co 



+E[jE{{u{t)-u{t))%{t)\£,}dt]. 





Then 



J{u) - J{u) > Um E[X{T){Y(T) - Y{T))] - ]im EE \p{T){X{T) - X{T))] 

T^oo T^oo 
oo 

+ E[jE{^{t)\£t}{u{t)-umt]. 



By assumptions (Hi) and {H3), we conclude 

J(w) - J{u) > 
i.e.-u is an optimal control. ■ 

3 Necessary conditions of optimality for partial 
information 

A drawback of the previous section is that the concavity condition is not always 
satisfied in applications. In view of this, it is of interest to obtain conditions for 
an optimal control with partial information where concavity is not needed. We 
assume the following: 

(Ai) For all u G Ae and all /3 e As bounded, there exists e>0 such that 

u + sfi e As for all s G (-e, e). 

(A2) For all to, h and all bounded £(Q-mesurable random variables a, the 
control process I3{t) defined by 

m = al[e,s+h){t) (3.1) 

belongs to As- 

(A3) For all bounded /3 G As, the derivative processes 

m := £X-+^^{t) U (3-2) 



<^(t) := £Y^+^nt) U (3.3) 



V{t) := ^Z^+^f'it) (3.4) 
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(3.5) 



exist and 



+ 



+ 



dx; 



^{r)dr 



t-5 



+ 



UitUt) + ^{mt) + j \^kf{t,a)i,{t,a)\v{da)}dt<^. 

Ro 



We can see that 



(3.6) 



and 



Note that 



t-5 



^{t) = for t e [-6, 0] . 



Theorem 3.1 Suppose that u € As with corresponding solutions X{t),Xi{t),X2{t), Y{t),Z{t),K {t, a), 

X{t),p{t),q{t) andf{t,a) of equations {1. 1) , (1.2), (1.10) anrf (1.11). 
Assume that (2.1) — (2.4) and the following transversality conditions hold: 



lim E[ man = o, 

T->oo 

lim E[X{T)cl>iT)] = 0. 

T-foo 



{Hq) Moreover, assume that the following growth condition holds 
E[J{XHt){vHt) + J ^^{t,a)u{da))+cf>\t){{^nt) + f VuH\t,a)u{da)) 

Ro Ro 

+p'W(iWe(t) + ^(0e(i-<5) + ^(t) / e-P(*-'-)^(r)dr + f^(t)/3(t))2 



+m{nfxMm + &,a)at -5) + ^^{t,a) J e-^(*-)^(r)dr + |^(t, a)^(t)p^(da))}rft] < oo 

Rq t-5 

for all T <oo. 

Then the following assertions are equivalent, 
(i) For all bounded /3 G Ae, 

^J{u + sP) |_„=0. 
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(a) For all t G [0, oo), 

E[^H{t,X{t),X,{t),X2{t)S{t)J{t),K{t,-),u,X{t),m,m,r{t,-)) I ^4=<i(t) = 0. 

Proof, (i) ==> (m): 

It follows from (1.1) that 

dm = &mt) + ^imt -S) + / e-''(*-'-)^(r)dr + |^ (t)/3(t)}dt 

t-5 

+&m + §§:mit-S) + -§§-^it) J e-f(*-^)ar)dr+^{t)m}dB{t) 

t-5 

+ /{£ (*.«)^(*) + £:it,a)at-6) + M.(^t,a) J e-''(*-^^^{r)dr+^it,a)m}N{dt,da), 

Ro t-5 

and 

dm = {-^it)m - i^mit -s)- ^W^/ e-^(*-'-)e(r)dr - ^{t)m 

-^{t)l3{t) - f,{t)n{t)}dt + v{t)dB{t) + J ^{t,a)N{dt,da), 

where for simplicity of notation, we have set 

d d 

g^Kt) = —b{t,X{t),Xi{t),X2{t),u{t)) etc. 
Suppose that assertion {i) holds. Then 

OO t 

t-5 

+^{tUt) + ^imt) + J ykf{t,a)i,{t,a)u{da)}dt + h'iY{0))m]- 

Ko 

(3.7) 

We know by the definition of H that 

Ro 

and similarly for ^(t), ^{t), ^(t), f (t), ff (t) and V,/(t,a). 
By the Ito formula and (Hq), we get 

E[h'{Y{Q)m)] = E[mm] 

= lim^E[XiT)cj>{T)] 

- hm £;[/{A(t)(-|f (t)e(O - ^(t)e(t ~S)~^^it) J e'P('-^^ar)dr - ||(t)^(t) 

t-(5 

-iW'/W - ^(.mt)) + m%{t) + ^Wlf W + / VuH{t,am,a)u{da)]dt\. 

Ko 

(3.8) 
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Substituting (3.8) into (3.7) we get 

oo t 

= EU&m + M^mit -S) + ^(t)^/ e-^(*-'-)C(r)rfr + ^{tm 

+ U{tMt) + ^imt) + I Vkfit, a)i>{t, a)v{da) 

Ro 

-A(i)(-§f W^W - ^Smt -5)- ^it)J^ e-P('-Mr)dr - %{mt) 

Mo 

(3.9) 

Applying the Ito formula to p{T)^(T) and using (-ffe), we get 
= lim E\p{T) an 

I — >-oo 

OO t 

= E[jm {§mit) + ^mit -S) + ^H) J e-^(*-)e(r)rfr + §^mt)}dt 

t-5 

oo CX) t 

+ J mEHt) I j'tjdt + J m&m + §§imt -5) + ^(t) / e->'^'-^)ar)dr + ^{t)m}dt 

t-5 

00 t 

+ S Sr{t,a){^^{t,a)m + -§l-St,a)at-5) + -ll-^{t,a) J e-''('-^^C{r)dr + ^{t,a)mMda)dt] 

Rn t-S 



:-Aj^u + sP) U=o +E[J ^{t)l3{t)dt]. 



Adding (3.9) and (3.10) we obtain 

OO 

E[J^{mt)dt]=0. 



Now apply this to 

/3{t) = al[s.s+h){t) 
where a{oj) is bounded and ft(j-niesurable, s > to. Then we get 

s+h 



(3.10) 



E[ J ^{s)ds a] = 



Differentiating with respect to /i at /i = we obtain 

E[^{s) a] = 
Since this holds for all s > to and all a, we conclude 

This proves that (i) implies (ii). 
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The argument above shows that 



oo 







for all w, /3 e As with /3 bounded. So to complete the proof we use that 
every bounded j3 G Ag can be approximated by linear combinations of controls 
/3 of the form (3.1). We omit the details. ■ 

4 Application to optimal consumption with re- 
spect to recursive utility 

4.1 A general optimal recursive utility problem 

Let X{t) = X'^''\t) be a cash flow modelled by 

C dXit)^ X{t-5)[ho{t)dt + ao{t)dB{t) + J -f{t,a)N{dt,da)] - c{t)dt;t > 



where 6o(i), cro(i) and jit, a) arc given bounded J"i-predictable processes, 
5 > is a fixed delay and ^{t, a) > —1 for all {t, a) £ [0, oo) x R. 

The process u{t) = c{t) > is our control process, interpreted as our relative 
consumption rate such that X^'^'>{t) > for all t >0. We let A denote the family 
of all J^t-predictable relative consumption rates. To every c G ^ we associate 
a recursive utility process Y^''\t) = Y{t) defined as the solution of the infinite 
horizon BSDE 



valid for all deterministic T < oo. We assume that Y{t) satisfies (1.4) (See 
DufHe & Epstein (1992)). 

Suppose the solution Y{t) of the infinite horizon BSDE (4.2) satisfies the 

condition (1.4) and let c{s):s > be the consumption rate. 

We assume that the function g{t,y,c) satisfies the following conditions: 

• g{t, y, c) is concave with respect to y and c 




(4.1) 



T 



Y{t) = E[Y{T) + Jg (s, F(s), c(s)) ds \ J^t] for all t < T, (4.2) 



oo 



/ E [\g{s, Y{s), c(s))|] < 00 for all c e ^ 



(4.3) 







• -^g{t,y,c) has an inverse: 
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, \ - j ^ iiv > vo{t,w) 

i[t,v,w) - <^ ( ifO<v< vo{t,w) 

where vo is §^g{t,y,Q). 

We study the problem to find c* & A such that 

supy(")(o) = y('^*Ho). (4.4) 

We call such a process c* a recursive utility optimal consumption rate. 
We see that the problem (4.5) is a special case of problem (1.8) with 

j{u) = r(o) 

f — , h{y) — y , u = c and 

b{t, X, xi,X2,u) = xibo{t) — c 
a{t,x,Xi,X2,u) = Xiao{t) 
6{t, X, xi,X2, u, a) = Xij{t, a) 

In this case the Hamiltonian defined in (1.9) takes the form 

H{t,x,Xi,X2,y,z,k{-),u,X,p,q,r{-)) = Xg{t,y,c) + {xiboit) - c)p 

+ xiao{t)q + xi j 'y{t,a)r{a)p{da) (4.5) 

Ro 

Maximizing ff as a function of c gives the first order condition 

X{t)^^{t,Y{t),c{t))=E\p{t)\£t] (4.6) 

for an optimal c{t). 

The pair of adjoint processes (l.lO)-(l.ll) is given by 

\9g 



( dX{t) = Xit)^{t,Y{t),c{t))dt 
lA(0) = l ^■'> 



and 



dp{t) = E[n{t) I J^tjdt + q{t)dB{t) + j r{t, a)N{dt, da); t € [0, oo) (4.8) 

Ko 

where 

M(i) = -[Hi)p{i + '5) + (To{t)q{t + 5) 

+ j 7(i, a)r{t + 5, a)v{da)] (4.9) 
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Equation (4.7) has the solution 

X{t) = exp(/^(s, Y{s),c{s))ds);t > (4.10) 



which substituted into (4.6) gives 

|^(t, Yit),c{t)) eMl^is, Y{s),c{s))ds) = E[p{t) | £,] (4.11) 

Hence, to find the optimal consumption rate c it suffices to find 

E\p{t)\£t];t>0. 

Wc refer to Theorem 5.1 in [1] for a proof of the existence of the solution of 
the ABSDE (4.8). 

4.2 A solvable special case 

In order to get a solvable case we choose the driver g in (4.2) to be of the form 

g{t,y,c)^-a{t)y + \nc (4.12) 

where a{t) > a > is an J^^-adapted process. 
We also choose 

S = eiiid£t=J^t]t>0 (4.13) 
and we represent the consumption rate c{t) as 

c{t) = pit)X{t), (4.14) 

where p{t) > is the relative consumption rate. 

Wc assume that p is bounded away from 0. This set of controls is denoted 
by A 

The FBSDE system now has the form 

r dX{t)^X{t~)[{bo{t)-p{t))dt + ao{t)dB{t) + J -f{t,a)N{dt,da)];t > 
[ X{0) =x>0 

(4.15) 

and 

Y{t) = Y^P'^ (t) = E[Y{T) + J (-a(s)F(s) + In c(s)) ds \ J^t] (4.16) 

t 

i.e. 

dY{t) = - {-a{t)Y{t) +liic(t)) dt + Z{t)dB{t);t > (4.17) 
We want to find p* G A such that 

supF('')(0) = r(''*)(0) (4.18) 
14 



In this case the Hamiltonian (1.9) gets the form 

H{t, X, y, p, A, p, q, r) = X{-a{t)y + ln{px)) + x {bo{t) - p)p 

+ xao{t)q + x J ^{t,a)r{a)v{da) (4-19) 

Ko 

Maximizing H with respect to p gives the first order equation 

\{t)^^=p{t)X{t) (4.20) 

where, by (1.10) - (1.11) X{t) and {p{t),q{t),r{t,a)) satisfy the FBSDEs 

dA(t) = -a(i)A(i)di 
A(0) = 1 

and 

dpit) = -[A(i)^ + (boit) - p{t))p{t) + ao{t)q{t) 

+ J j{t, a)r{a)u{da)]dt + q{t)dB{t) + J r{t, a)N{dt, da) (^-22) 

Mo Mo 

The infinite horizon BSDE (4.22) has a unique solution, (see Theorem 3.1 
in [8]). 

Then, the solutions of (4.21) — (4.22) are respectively, 

t 

X{t) = exp(-/ a{s)ds) (4.23) 



and, for all < i < T and all T < oo, 

pitnt) = E\p{T)T{T) + ms)^^ds I U (4.24) 

where T{t) is given by 

dr{t) = r{t-)[{bo{t) - p{t)) dt + ao{t)dB{t) 

+ J j{t,a)N{dt,da)];t>0 (4 35) 

r(o) = 1 

(See e.g.[14,18]). 
This gives 

r(i) = exp(-/ ao{s)dB{s) + J {bo{s) - p{s) - ^a^{s)}ds 


t 

+J J {ln(l + 7(s, a)) - 7(s, a)}u{da)ds (4.26) 

Mo 
I 

+J J \n{l+j{s,a))N{ds,da);t>0 

Ro 
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Comparing with (4.15) we see that 

X{t)=xT{ty,t>0 (4.27) 
Substituting this into (4.24) we obtain 

pit)X{t) = E\p{T)X{T) + J exp(-/a(r)rfr)ds | Ji] (4.28) 

t 

Since p is bounded away from we deduce from (4.20) that 
X(T) 1 

p{T)X{T) = = exp(-/ a{r)dr) dominatedly as T ^ oo. 

(4.29) 

Hence, by letting T ^ oo in (4.28) we get 

oo s 

p{t)X{t) = £;[/ exp(-/ a{r)dr)ds \ Tt] (4.30) 
t 

By (4.20) we therefore get the optimal relative consumption rate 

s 

exp{—Ja{r)dr) 

p{t) = p*{t) = ^ ;i>0 (4.31) 

E[ J eycp{- Ja{r)dr)ds \ Ft] 

t 

In particular, if a(r) = a > (constant) for all r, then 

p*{t) =a;t>Q. (4.32) 

With this choice of p* the transversality conditions {Hi) and {H^) hold and 
we have proved: 

Theorem 4.1 The optimal relative consumption rate p* {t) for problem (4.12) — 
(4.18) is given by (4.31). 

In particular, if a{r) = a > (constante) for all r, thenp*{t) = a; for all t. 
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